Overview of the NTCIR-11 QA-Lab Task
نویسندگان
چکیده
This paper describes an overview of the first QA Lab (Question Answering Lab for Entrance Exam) task at NTCIR 11. The goal of the QA lab is to provide a module-based platform for advanced question answering systems and comparative evaluation for solving real-world university entrance exam questions. In this task, “world history” questions are selected from The National Center Test for University Admissions and from the secondary exams at 5 universities in Japan. This paper also describes the used data, baseline systems and formal run results.
منابع مشابه
Forst: Question Answering System for Second-stage Examinations at NTCIR-12 QA Lab-2 Task
Japanese university entrance exams have two stages: The National Center Test (multiple choice-type questions) and second-stage examinations (complex questions including terms and essays). We participated in all phases of NTCIR-11 QA Lab-1 and NTCIR-12 QA Lab-2 task’s Japanese subtask and our system answered all of the questions. At QA Lab-2 task, we focused on term and essay questions in the se...
متن کاملForst: Question Answering System Using Basic Element at NTCIR-11 QA-Lab Task
This paper describes Forst's approach to university entrance examinations at NTCIR-11 QA-Lab Task. Our system consists of two types of modules: dedicated modules for each question format and common modules called by the dedicated modules as necessary. Our system uses Basic Element in order to more exactly grasp and reflect the import of questions. We also tackled short-essay questions in the se...
متن کاملA Feature-based Classification Technique for Answering Multi-choice World History Questions: FRDC_QA at NTCIR-11 QA-Lab Task
Our FRDC_QA team participated in the QA-Lab English subtask of the NTCIR-11. In this paper, we describe our system for solving real-world university entrance exam questions, which are related to world history. Wikipedia is used as the main external resource for our system. Since problems with choosing right/wrong sentence from multiple sentence choices account for about two-thirds of the total,...
متن کاملOverview of the NTCIR-12 QA Lab-2 Task
The NTCIR-12 QA Lab-2 task aims at the real-world complex Question Answering (QA) technologies using Japanese university entrance exams and their English translation on the subject of “World history”. The exam questions are roughly divided into multiple-choice and free-description styles, and have various question formats, which are essay, factoid, slot-filling, true-or-false and so on. We cond...
متن کاملCMUQA: Multiple-Choice Question Answering at NTCIR-12 QA Lab-2 Task
The first version of the UIMA-based modular automatic question answering (QA) system was developed for NTCIR11 QA Lab task[5]. The system answers multiple-choice English questions for the Japanese university entrance examinations on the subject of world history. We made improvements in the current system by adding components focused towards Source Expansion and better Semantic Understanding of ...
متن کامل